Generative Adversarial Networks Research Articles

Automatic arrival-time picking of P- and S-waves of micro-seismic events based on relative standard generative adversarial network and GHRA

AbstractRapid, high-precision pickup of microseismic P- and S-waves is an important basis for microseismic monitoring and early warning. However, it is difficult to provide fast and highly accurate pickup of micro-seismic P- and S-waves arrival-time. To address this, the study proposes a lightweight and high-precision micro-seismic P- and S-waves arrival times picking model, lightweight adversarial U-shaped network (LAU-Net), based on the framework of the generative adversarial network, and successfully deployed in low-power devices. The pickup network constructs a lightweight feature extraction layer (GHRA) that focuses on extracting pertinent feature information, reducing model complexity and computation, and speeding up pickup. We propose a new adversarial learning strategy called application-aware loss function. By introducing the distribution difference between the predicted results and the artificial labels during the training process, we improve the training stability and further improve the pickup accuracy while ensuring the pickup speed. Finally, 8986 and 473 sets of micro-seismic events are used as training and testing sets to train and test the LAU-Net model, and compared with the STA/LTA algorithm, CNNDET+CGANet algorithm, and UNet++ algorithm, the speed of each pickup is faster than that of the other algorithms by 11.59ms, 15.19ms, and 7.79ms, respectively. The accuracy of the P-wave pickup is improved by 0.221, 0.01, and 0.029, respectively, and the S-wave pickup accuracy is improved by 0.233, 0.135, and 0.102, respectively. It is further applied in the actual project of the Shengli oilfield in Sichuan. The LAU-Net model can meet the needs of practical micro-seismic monitoring and early warning and provides a new way of thinking for accurate and fast on-time picking of micro-seismic P- and S-waves.

Exploring Generative Adversarial Networks for Face Generation

This research has used Generative Adversarial Networks (GANs) for face generation in the area of the research [1]. GANs have demonstrated a high effectiveness in imitation of natural images not only, but also in specific applications [2]. For the succeeding paper, their potential especially on creating human faces are being looked into. The primary goal is to develop a new design and practical training strategy to efficiently produce high-quality facial images [3]. Experimental results confirm the ability of the proposed method to generate artificially intelligent faces and its role in improving the quality of the images.

FLAIR MRI sequence synthesis using squeeze attention generative model for reliable brain tumor segmentation

Manual segmentation of brain tumors using structural magnetic resonance imaging (MRI) is an arduous and time-consuming task. Therefore, automatic and robust segmentation will considerably influence neuro-oncological clinical trials by reducing excessive manual annotation time. Herein, we propose a deep learning model that automatically segments brain tumors even in cases of missing MRI sequences, which are common in practical clinical settings. To address this issue, we enhance a generative adversarial network (GAN) by incorporating a squeeze-and-excitation (SE) attention module into its generator and a PatchGAN into its discriminator. The SE module recalibrates channel responses by explicitly modeling interdependencies, enabling the network to focus on critical regions such as tumor areas. Our proposed generative model is optimized using a combination of adversarial, structural similarity, and mean absolute error losses to synthesize missing MRI sequences more effectively. This enhancement allows our model to synthesize the missing MRI sequence (fluid attenuated inversion recovery [FLAIR]) by leveraging information from other available sequences (T1-weighted, T2-weighted, or contrast-enhanced T1-weighted [T1ce]). For the segmentation task, we employ an optimized nnU-Net model, which is trained using existing sequences and evaluated using both available and synthesized sequences (including missing ones), mimicking real-world scenarios where often only limited MRI sequences are available or usable. Our findings reveal a notable enhancement in brain tumor segmentation, as indicated by a significant increase in overall the Dice similarity coefficient (DSC) from 0.688% (when FLAIR is missing) to 0.873% (when using synthesized FLAIR derived from T2). This improvement brings the segmentation performance closer to what was achieved when real FLAIR was available, where the DSC reaches 0.901%. Moreover, our synthesizing model was also tested on two additional datasets: the BraTS 2020 validation set and BraTS Africa 2023 training set, which produces results comparable to those of BraTS 2021, thereby proving its robustness and generalizability. In addition, the resulting tumor segmentations are subsequently employed to assess the response to treatment in cases where all sequences were available and when synthesis was employed, according to response assessment in neuro-oncology criteria.

Fully embedded time series generative adversarial networks

Fully embedded time series generative adversarial networks

TFSemantic: A Time–Frequency Semantic GAN Framework for Imbalanced Classification Using Radio Signals

Recently, wireless sensing techniques have been widely used for Internet of Things (IoT) applications. Unlike traditional device-based sensing, wireless sensing is contactless, pervasive, low cost, and non-invasive, making it highly suitable for relevant IoT applications. However, most existing methods are highly dependent on high-quality datasets, and the minority class will not achieve a satisfactory performance when suffering from a class imbalance problem. In this article, we propose a time–frequency semantic generative adversarial network framework (i.e., TFSemantic) to address the imbalanced classification problem in human activity recognition using radio frequency (RF) signals. Specifically, the TFSemantic framework can learn semantic features from the minority classes and then generate high-quality signals to restore data balance. It includes a data pre-processing module, a semantic extraction module, a semantic distribution module, and a data augmenter module. In the data pre-processing module, we process four different RF datasets (i.e., WiFi, RFID, UWB, and mmWave). We also develop Fourier semantic feature convolution and attention semantic feature embedding methods for the semantic extraction module. A discrete wavelet transform is utilized for reconstructed RF samples in the semantic distribution module. In data augmenter module, we design an associated loss function to achieve effective adversarial training. Finally, we validate the effectiveness of the proposed TFSemantic framework using different RF datasets, which outperforms several state-of-the-art methods.

Integrating Unsupervised and Supervised ML Models for Analysis of Synthetic Data From VAE, GAN, and Clustering of Variables

Clustering of variables is a specialized approach for dimensionality reduction. This strategy is evaluated for data reduction with a Kaggle diabetes dataset. Since the original dataset is small, Generative Adversarial Networks (GAN) and Variational Autoencoders (VAE) are used to generate 100,000 records and tested for resemblance to the real data using standard statistical methods. VAE-data is more representative of the real data than GAN-data when analyzed using machine learning (ML) models. Applying Clustering of Variables on VAE-data yields new synthetic variables (SV). SV-data is then augmented with target variable data. Random Forest model is used on VAE and SV data. SV-data results matched VAE-data, proving the new data's quality. SV-data also provides insights into correlations and data dispersion patterns. This analysis implements a combination of Unsupervised learning (clustering of variables) and Supervised learning (classification) which is reflected in the results.

An Adaptive Enhancement Method of Malicious Traffic Samples Based on DCGAN-ResNet System

A malicious traffic sample adaptive enhancement device based on Deep Convolutional Generative Adversarial Network (DCGAN) is designed to address the issue of imbalanced network traffic data distribution, aiming to enhance the accuracy and efficiency of anomaly detection. By leveraging generative adversarial network technology, this device can generate samples similar to real malicious traffic to balance the training dataset. It utilizes the generator and discriminator of the Deep Convolutional Generative Adversarial Network (DCGAN), combined with the residual network (ResNet) in the CNN model, to enhance the quality of generated samples. The device can switch states to adapt to various network environments and has been experimentally validated for its effectiveness and feasibility.Moreover, employing an adaptive device, the samples of malicious traffic are adjusted. Experimental analysis demonstrates that the device significantly enhances the accuracy of anomaly traffic detection, improves robustness, and provides robust support for network security protection.

Interactive learning of natural sign language with radar

AbstractOver the past decade, there have been great advancements in radio frequency sensor technology for human–computer interaction applications, such as gesture recognition, and human activity recognition more broadly. While there is a significant amount of study on these topics, in most cases, experimental data are acquired in controlled settings by directing participants what motion to articulate. However, especially for communicative motions, such as sign language, such directed data sets do not accurately capture natural, in situ articulations. This results in a difference in the distribution of directed American Sign Language (ASL) versus natural ASL, which severely degrades natural sign language recognition in real‐world scenarios. To overcome these challenges and acquire more representative data for training deep models, the authors develop an interactive gaming environment, ChessSIGN, which records video and radar data of participants as they play the game without any external direction. The authors investigate various ways of generating synthetic samples from directed ASL data, but show that ultimately such data does not offer much improvement over just initialising using imagery from ImageNet. In contrast, an interactive learning paradigm is proposed by the authors in which model training is shown to improve as more and more natural ASL samples are acquired and augmented via synthetic samples generated from a physics‐aware generative adversarial network. The authors show that the proposed approach enables the recognition of natural ASL in a real‐world setting, achieving an accuracy of 69% for 29 ASL signs—a 60% improvement over conventional training with directed ASL data.

Enhanced Solar Coronal Imaging: A GAN Approach with Fused Attention and Perceptual Quality Enhancement

The activity of the solar corona has a significant impact on all aspects of human life. People typically use images obtained from astronomical telescopes to observe coronal activities, among which the Atmospheric Imaging Assembly (AIA) of the Solar Dynamics Observatory (SDO) is particularly widely used. However, due to resolution limitations, we have begun to study the application of generative adversarial network super-resolution techniques to enhance the image data quality for a clearer observation of the fine structures and dynamic processes in the solar atmosphere, which improves the prediction accuracy of solar activities. We aligned SDO/AIA images with images from the High-Resolution Coronal Imager (Hi-C) to create a dataset. This research proposes a new super-resolution method named SAFCSRGAN, which includes a spatial attention module that incorporates channel information, allowing the network model to better capture the corona’s features. A Charbonnier loss function was introduced to enhance the perceptual quality of the super-resolution images. Compared to the original method using ESRGAN, our method achieved an 11.9% increase in Peak Signal-to-Noise Ratio (PSNR) and a 4.8% increase in Structural Similarity (SSIM). Additionally, we introduced two perceptual image quality assessment metrics, the Natural Image Quality Evaluator (NIQE) and Learned Perceptual Image Patch Similarity (LPIPS), which improved perceptual quality by 10.8% and 1.3%, respectively. Finally, our experiments demonstrated that our improved model surpasses other models in restoring the details of coronal images.

Enforcing Traffic Safety: A Deep Learning Approach for Detecting Motorcyclists’ Helmet Violations Using YOLOv8 and Deep Convolutional Generative Adversarial Network-Generated Images

In this study, we introduce an innovative methodology for the detection of helmet usage violations among motorcyclists, integrating the YOLOv8 object detection algorithm with deep convolutional generative adversarial networks (DCGANs). The objective of this research is to enhance the precision of existing helmet violation detection techniques, which are typically reliant on manual inspection and susceptible to inaccuracies. The proposed methodology involves model training on an extensive dataset comprising both authentic and synthetic images, and demonstrates high accuracy in identifying helmet violations, including scenarios with multiple riders. Data augmentation, in conjunction with synthetic images produced by DCGANs, is utilized to expand the training data volume, particularly focusing on imbalanced classes, thereby facilitating superior model generalization to real-world circumstances. The stand-alone YOLOv8 model exhibited an F1 score of 0.91 for all classes at a confidence level of 0.617, whereas the DCGANs + YOLOv8 model demonstrated an F1 score of 0.96 for all classes at a reduced confidence level of 0.334. These findings highlight the potential of DCGANs in enhancing the accuracy of helmet rule violation detection, thus fostering safer motorcycling practices.

A novel generative adversarial network-based fuzzing cases generation method for industrial control system protocols

With the interconnection and networking of industrial control systems (ICS), security vulnerabilities in ICS protocols have become a major source of threats to these systems. In order to discover these vulnerabilities and maintain ICS security, generative adversarial network-based fuzz testing (Fuzzing) has been introduced as a popular method to discover vulnerabilities in industrial control system protocols (ICSPs). However, the current approach based on generative adversarial network fuzz testing suffers from problems in terms of compatibility and repetitive generation of test examples, and low acceptance rate. To address these issues, this paper proposes a fuzzing approach based on the synergy of Wasserstein Generative Intelligent Networks (WGAN) and Variation Autoencoder (VAE). In addition, we design an intelligent fuzz framework, WGGFuzz, to efficiently generate a large number of test cases while ensuring the accuracy of the testing results for efficiently generating a large number of test cases in a short period of time. The framework, which does not incorporate ICSPs applicable to a wide range of, shows through experiments that WGGFuzz can be able to achieve 91% in terms of TCRR, 1.41 in terms of ATE, and better performance in terms of DGD.

Mobile User Traffic Generation via Multi-Scale Hierarchical GAN

Mobile user traffic facilitates diverse applications, including network planning and optimization, whereas large-scale mobile user traffic is hardly available due to privacy concerns. One alternative solution is to generate mobile user traffic data for downstream applications. However, existing generation models cannot simulate the multi-scale temporal dynamics in mobile user traffic on individual and aggregate levels. In this work, we propose a multi-scale hierarchical generative adversarial network (MSH-GAN) containing multiple generators and a multi-class discriminator. Specifically, the mobile traffic usage behavior exhibits a mixture of multiple behavior patterns, which are called micro-scale behavior patterns and are modeled by different pattern generators in our model. Moreover, the traffic usage behavior of different users exhibits strong clustering characteristics, with the co-existence of users with similar and different traffic usage behaviors. Thus, we model each cluster of users as a class in the discriminator’s output, referred to as macro-scale user clusters. Then, the gap between micro-scale behavior patterns and macro-scale user clusters is bridged by introducing the switch mode generators, which describe the traffic usage behavior in switching between different patterns. All users share the pattern generators. In contrast, the switch mode generators are only shared by a specific cluster of users, which models the multi-scale hierarchical structure of the traffic usage behavior of massive users. Finally, we urge MSH-GAN to learn the multi-scale temporal dynamics via a combined loss function, including adversarial loss, clustering loss, aggregated loss, and regularity terms. Extensive experiment results demonstrate that MSH-GAN outperforms state-of-art baselines by at least 118.17% in critical data fidelity and usability metrics. Moreover, observations show that MSH-GAN can simulate traffic patterns and pattern switch behaviors.

GACDNet:Mapping winter wheat by generative adversarial cross-domain networks with transformer integration for zero-sample extraction

Accurate extraction of winter wheat area is essential for wheat yield estimation. Remotely sensed images have limited coverage, are taken at different times, from different angles and in different geographical areas, and the spectral information of the same feature varies from image to image. Machine learning methods are very popular in extracting winter wheat planting area, there are differences between different images, namely the distribution differences between source domain data and target domain data, the results obtained by these methods directly applied to other areas are not satisfactory. To achieve cross regional extraction of winter wheat area, we propose generative adversarial cross-domain networks for image classification under the same image type. The cross-domain network proposed comprises a generative network and a feature extractor. The generative network creates diverse and acceptable samples from the initial input data, constrained by the contrast loss. The feature extractor converts the initial input data and the generated data into a high-level representation. Two time series datasets were constructed and a series of experiments were conducted on these datasets, obtaining high-precision and optimal classification results. Sample training was performed using 70%, 50%, 30% and 10% of the data on both datasets. The study results demonstrated the high performance and cross-domain capability of our network. Furthermore, the winter wheat cultivation area of the entire Zhoukou city was extracted, yielding results with an accuracy of 94.23%. Extensive experiments and applications on the dataset demonstrate that our method is feasible and reliable.

Batch data recovery from gradients based on generative adversarial networks

Batch data recovery from gradients based on generative adversarial networks

Few-shot SAR vehicle target augmentation based on generative adversarial networks

Abstract. The study of few-shot SAR image generation is an effective way to expand the SAR dataset, which not only provides diversified data support for SAR target classification, but also provides a high-fidelity false image template for SAR deceptive jamming. In this paper, we have constructed a multi-frequency and multi-target type SAR vehicle imagery dataset that encompasses frequencies such as X, Ka, P, and S bands. The vehicle types are coaster, suv and cabin. Subsequently, we utilized various Generative Adversarial Networks for image generation from the SAR vehicle dataset. The experimental result indicates that the images generated by the DCGAN and the LSGAN models are of superior quality. Furthermore, we employed different recognition networks to evaluate the classification accuracy of the generated images. Of all the frequency bands, the Ka band generated images achieved the highest recognition rate, with an accuracy of up to 99%. Under conditions of a limited number of samples, the LSGAN model performed the best, reaching a classification recognition rate of 71.48% with a dataset of only 20 samples. Finally, we use a conditional network generation model to generate conditions based on target categories and frequency bands, providing high fidelity samples for SAR deception jamming.

DAE-GAN: Underwater Image Super-Resolution Based on Symmetric Degradation Attention Enhanced Generative Adversarial Network

Underwater images often exhibit detail blurring and color distortion due to light scattering, impurities, and other influences, obscuring essential textures and details. This presents a challenge for existing super-resolution techniques in identifying and extracting effective features, making high-quality reconstruction difficult. This research aims to innovate underwater image super-resolution technology to tackle this challenge. Initially, an underwater image degradation model was created by integrating random subsampling, Gaussian blur, mixed noise, and suspended particle simulation to generate a highly realistic synthetic dataset, thereby training the network to adapt to various degradation factors. Subsequently, to enhance the network’s capability to extract key features, improvements were made based on the symmetrically structured blind super-resolution generative adversarial network (BSRGAN) model architecture. An attention mechanism based on energy functions was introduced within the generator to assess the importance of each pixel, and a weighted fusion strategy of adversarial loss, reconstruction loss, and perceptual loss was utilized to improve the quality of image reconstruction. Experimental results demonstrated that the proposed method achieved significant improvements in peak signal-to-noise ratio (PSNR) and underwater image quality measure (UIQM) by 0.85 dB and 0.19, respectively, significantly enhancing the visual perception quality and indicating its feasibility in super-resolution applications.

An in-depth evaluation of deep learning-enabled adaptive approaches for detecting obstacles using sensor-fused data in autonomous vehicles

This paper delivers an exhaustive analysis of the fusion of multi-sensor technologies, including traditional sensors such as cameras, Light Detection and Ranging(LiDAR), Radio Detection and Ranging(RADAR), and ultrasonic sensors, with Artificial Intelligence(AI) powered methodologies in obstacle detection for Autonomous Vehicles(AVs). With the growing momentum in AVs adoption, a heightened need exists for versatile and resilient obstacle detection systems. Our research delves into study of literatures, where proposed approaches assimilate data from this diverse sensor suite, integrated through Deep Learning(DL) techniques, to refine AV performance. Recent advancements and prevailing challenges within the domain are thoroughly examined, with particular focus on the integration of sensor fusion techniques, the facilitation of real-time processing via edge and fog computing, and the implementation of advanced artificial intelligence architectures, including Convolutional Neural Networks(CNNs), Recurrent Neural Networks(RNNs), and Generative Adversarial Networks(GANs), to enhance data interpretation efficacy. In conclusion, the paper underscores the critical contribution of multi-sensor arrays and deep learning in enhancing the safety and reliability of autonomous vehicles, offering significant perspectives for future research and technological progress.

Cross Domain Early Crop Mapping with Label Spaces Discrepancies using MultiCropGAN

Abstract. Mapping target crops before the harvest season for regions lacking crop-specific ground truth is critical for global food security. Utilizing multispectral remote sensing and domain adaptation methods, prior studies strive to produce precise crop maps in these regions (target domain) with the help of the crop-specific labelled remote sensing data from the source regions (source domain). However, existing approaches assume identical label spaces across those domains, a challenge often unmet in reality, necessitating a more adaptable solution. This paper introduces the Multiple Crop Mapping Generative Adversarial Neural Network (MultiCropGAN) model, comprising a generator, discriminator, and classifier. The generator transforms target domain data into the source domain, employing identity losses to retain the characteristics of the target data. The discriminator aims to distinguish them and shares the structure and weights with the classifier, which locates crops in the target domain using the generator’s output. This model’s novel capability lies in locating target crops within the target domain, overcoming differences in crop type label spaces between the target and source domains. In experiments, MultiCropGAN is benchmarked against various baseline methods. Notably, when facing differing label spaces, MultiCropGAN significantly outperforms other baseline methods. The Overall Accuracy is improved by about 10%.

Compressed Video Sensing Based on Deep Generative Adversarial Network

Compressed Video Sensing Based on Deep Generative Adversarial Network

DCGAN-DTA: Predicting drug-target binding affinity with deep convolutional generative adversarial networks

BackgroundIn recent years, there has been a growing interest in utilizing computational approaches to predict drug-target binding affinity, aiming to expedite the early drug discovery process. To address the limitations of experimental methods, such as cost and time, several machine learning-based techniques have been developed. However, these methods encounter certain challenges, including the limited availability of training data, reliance on human intervention for feature selection and engineering, and a lack of validation approaches for robust evaluation in real-life applications.ResultsTo mitigate these limitations, in this study, we propose a method for drug-target binding affinity prediction based on deep convolutional generative adversarial networks. Additionally, we conducted a series of validation experiments and implemented adversarial control experiments using straw models. These experiments serve to demonstrate the robustness and efficacy of our predictive models. We conducted a comprehensive evaluation of our method by comparing it to baselines and state-of-the-art methods. Two recently updated datasets, namely the BindingDB and PDBBind, were used for this purpose. Our findings indicate that our method outperforms the alternative methods in terms of three performance measures when using warm-start data splitting settings. Moreover, when considering physiochemical-based cold-start data splitting settings, our method demonstrates superior predictive performance, particularly in terms of the concordance index.ConclusionThe results of our study affirm the practical value of our method and its superiority over alternative approaches in predicting drug-target binding affinity across multiple validation sets. This highlights the potential of our approach in accelerating drug repurposing efforts, facilitating novel drug discovery, and ultimately enhancing disease treatment. The data and source code for this study were deposited in the GitHub repository, https://github.com/mojtabaze7/DCGAN-DTA. Furthermore, the web server for our method is accessible at https://dcgan.shinyapps.io/bindingaffinity/.